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General  Goals  and  Characteristics  for  PSEI  Standards 


1 ,  Introduction 


1.1.  Scope 

This  document  describes  the  Department  of  the  Na^s  goals  and  general  cto^ter^s  for 
the  definition  and  specification  of  Project  Support  Enviro^^t^^SE)  Interface  (PSEI) 
standards  for  the  Next  Generation  Computer  Resources  (NGCR)  Program. 

PSEI  standards  are  essential  to  the  timely  and  cost  effective  dewlopment  of  Ae  ™ajonty  of 
Ae  next  generation  Navy  mission  critical  computing  systems.  PSEI  staridarj  wiU  ^sist 
Ae  Navy  m  efficiently  providmg  systems  which  address  a  mde  rarige  of  performance 
levels,  compatible  computing  service  levels,  and  functionality  levels. 

These  goals  and  characteristics  provide  general  guidance  to  Ae  NGCR  ftoject  Suppc^ 
Svironment  Standards  Working  Group  (PSESWG)  m  the  electron  of  PJEI  st^tods  It 
is  expected  Aat  more  specific  goals  and  charactensucs  will  be^fined  within  particular  PSE 
service  areas  to  guide  Ae  selection  of  m  Avidual  PSEI  standards. 

Each  general  goal  and  characteristic  is  described  in  a  subsection  of  this  docurnent.  In 
adAtion,  each  general  characteristic  description  includes  evaluation  criteria  with  a  sconng 

scheme  Itismtended  Aat  Aese  evaluation  criteria  be  used  for  subjective  scormg  and 

of  fompeting  standards;  quantitative  scoring  should  only  be  applied  to  Ae  specific 
characteristics  defined  for  a  particular  PSE  service  area. 

1.2.  Terminology 


The  goals  and  characteristics  in  Ais  document  are  presented  informally  and  at  a  fairly 
abstract  level.  It  may  not  be  possible  or  even  desirable  to  make  this  docunwnt  precise. 
However,  consistent  usage  of  terms  will  evolve  m  subsequent  revisions  of  Ais  document. 


2.  Goals 

2.1.  Transportability  of  Data,  Tools  and  Users 


TranspoitabAty  is  measured  in  Ae  degree  to  which  Ae  change  to  a  different  PSE  can  be 
accomplished  wiAout  rework. 

Data  transportability  refers  to  Ae  abAty  to  move  project  related  data  to  a  different  PSE 
wiAout  change  to  Ae  representation  format  of  Aat  data. 


Tool  transportability  refers  to  Ae  abAty  to  mstall  a  tool  on  a  different  PSE  wiAout 
changing  its  implementation. 

User  transportability  refers  to  Ae  abAty  of  a  PSE  usct  to  move  to  a  differeirt  PSE 
wiAout  requiring  retraining  on  Ae  PSE  user  mterface  and/or  on  Ae  mcluded  PSE  tools. 

2.2.  Quality  Interface 


The  goals  associated  wiA  Ae  quality  of  PSEI  standards  address  chara^ristics  of  st^dards 
which  directly  or  indirectly  specify  a  feature  of  Ae  mterface  Aat  contnbutes  to  over^ 
support  environment  desirabAty.  These  goals  are  boA  technics  and  psych9logical  m 
nature.  An  acceptable  mterface  standard  wA  have  high  subjective  or  objective  scores  m 
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many  of  the  stated  goals  for  quality  as  possible.  Quality  goals  have  been  grouped  into 
seven  broad  categories  for  comparison  purposes. 

''Modularity" 

Interface  standards  will  be  of  high  quality  if  they  are  self  contained,  well  defined,  and 
exhibit  the  technical  features  of  high  cohesion  and  low  coupling.  For  example,  int^aces 
which  have  no  coupling  are  pairwise  orthogonal  and  will  not  interact  or  conflict  with  each 
other  in  any  way. 

"Simplicity" 

The  cUent-to-interface  relationship  in  a  high  quality  standard  will  be  sttmgjit  forw^d  and 
tmcomplicated.  This  is  not  to  be  constmed  as  unsophisticated  or  of  minimal  functionality. 

"Minimal  Definition" 

This  goal  specifies  that  there  be  no  excess  specification  in  the  standard,  or  that  Ae  standard 
consists  of  primitives  and  control  of  those  primitives  only.  An  ideal  standard  will  have  a 
minimal  specification. 

"  Testability" 

The  interface  defined  by  a  quality  standard  wiQ  be  testable.  Further,  test  suites  or 
benchmarks  will  be  available  against  which  to  measure  performance  and  compliance  to  a 
standard.  This  characteristic  is  intended  to  include  the  concept  of  "Built-In-Test"  (BIT) 
provisions. 

"Friendliness  for  User  and  Buyer" 

This  goal  requires  that  in  order  for  a  PSEI  to  be  a  quality  interface  it  must 
understandable,  have  a  high  degree  of  safety  and  confidence  associated  with  it,  be  robust, 
and  be  recognized  as  such  by  both  buyers  and  users.  "Buyer"  is  used  here  to  mean  the 
Program  Manager  putting  together  an  acquisition  package  to  configure  a  PSE  for  his 
project  It  is  insufficient  tiiat  only  highly  technical  individuals  be  able  to  determine  the 
benefit  and  power  of  a  particular  interface  standard. 

"Producibility" 

This  goal  is  the  combined  effect  of  those  elements  of  a  design  and  the  planning  for  a  design 
that  enables  an  item  to  be  produced  in  the  least  amount  of  time  with  the  least  cost,  while  still 
meeting  the  necessary  quality  and  performance  requirements.  Producibility  applies  equally 
to  issues  concerning  software,  firmware,  hardware,  and  system  and  interface  specification 
and  production.  By  definition,  producibility  must  be  integral  with  aU  a^cts  of  a  PSE  from 
development  of  the  initial  concept  through  acceptance  testing  of  the  delivered  system. 
Continuous  evaluation  and  consideration  of  producibility  is  particularly  important  when 
meeting  the  stringent  requirements  of  mission  critical  computing  systems  which  may 
require  the  efficient  interaction  of  complex,  heterogeneous,  modularized  bacl^lane  bus 
architectures  or  the  utilization  of  a  single,  dedicated  processor.  Attrition  to  producibility  in 
the  development  phase  of  a  system,  whether  it  is  complex  or  simple,  will  enhwce 
operability  throughout  the  system's  life  cycle,  from  initial  fielding  througji  retirement. 

"PSE  Extensibility" 

Like  many  other  goals,  quality  goals  shall  be  compatible  with  and  e3q)andable  under  other 
PSE  specifications.  This  is  intended  to  include  the  concepts  of  open-ended  specifications 
and  upgradable  growth  potential. 

2.3.  User  Confidence 
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In  large  measure,  the  success  of  any  standard  depends  on  user  co^dence. 
standid  is  reflected  in  the  specification  of  an  interfa^.  user  confiden^  is  f  Ae  more 
important.  Developers  of  products  on  either  side  of  the  mrerface  are  My  to  be  unp^^  m 
ways  requiring  m^ifications  of  existing  products  or  products  under  development  in  order 
to  meet  the  interface  specification,  hi  addition,  there  is  Ae  potential  for  concerns  to  be 
raised  regarding  robusmess  (will  I  be  able  to  do  all  that  I  want  ^ok  Ae  interface), 
ambiguity  (will  Ae  specification  be  liable  to  variable  interpretanon  by  implementors), 
efficiency  (will  Ae  specification  admit  to  efficient  implementations),  and  orAogonaht^ 
Option  of  this  interfLe  specification  preclude  or  int^ere  wiA  choices  for  oAer  imerfaces 
or  oWucts).  Adoption  of  standard  interfaces  results  m  new  constramts  on  u^rs  wrme 
holding  out  Ae  promise  of  future  benefits  in  product  poitabUity,  ^nAroperabih^,  ^d 
maint^ability.  Wr  confidence  in  the  interface  specification  is  essential  if  he  is  to  be  asked 
to  invest  m  it  today  on  the  basis  of  a  promise  of  future  benefit.  Consequently,  ^r 
confidence  is  a  significant  goal  for  all  NGCR  products,  and  for  the  planned  PSEI 
specifications  m  particular. 

2.4.  Long  Life-time  Project  Support 

All  PSEs  must  be  developed  with  a  view  toward  a  long,  useful  life-tinie.  Consideration 
must  be  given  to  insuring  that  the  most  current  technology  is  employed  withm  the  system 
under  development  or  modification.  Use  of  technology,  even  though  advanced  and  state- 
of-the-art  or  state-of-Ae-practice,  must  be  proven  in  real,  current  syste^  to  engender  user 
support  and  confidence.  The  risks  for  implementation  of  the  system  or  mterface  technology 
should  be  analyzed  and  judged  acceptable  prior  to  production  decisions. 

To  msure  long-life  usefulness  of  a  system,  it  is  imperative  Aat  the  issues  of  growth  and 
modernization  of  a  system  be  considered  early.  New  tectaologies,  even  those  just  now  on 
the  horizon,  must  be  examined  for  potential  future  incliKion  m  the^ent  development^  or 
operational  system.  The  system  design,  insofar  as  possible,  must  be  logically  modeled  m 
such  a  way  as  to  ensure  extensibility  in  the  future.  Technology  insertion  inust  be  a  pnmary 
driver  in  developing  specifications  and  standards  to  insure  system  operabihty  wth  futoe 
technology.  Strategies  to  identify  and  capture  future  technology  rm^  te  examin^.  Strong 
consideration  must  be  given  to  using  commercial  off-Ae-shelf  (COTS)  software  m  an  effort 
to  drive  down  costs  and  add  vendor  support.  This  characteristic  maps  directly  to  OSI/lSO 
standards  and  specifications  under  review  within  Ae  NGCR  Program. 

The  projected  life  cycle  of  Ae  system  should  be  evaluat^  from  initial  concept,  given 
current  mature  technology  and  developmental  items  which  may  also  effete  long  term 
operation.  Factors  effecting  Ae  operating  environment  must  also  be  considered  in  hgjit  or 
current  and  viewable  future  technology.  Similarly,  plans  for  lay-away  ai^  potential 
mobilization  must  be  considered.  The  system  and  all  its  parts  and  the  deto^  and 
developed  interfaces  may  be  required  to  operate  on  a  rarnp-up  schedule  basis  after  some 
extended  period  of  dormancy.  Consequently,  Ae  logicalization  of  a  system  must  be  such 
that  long  life  can  be  achieved. 

2.5.  Reduced  Navy  Cost 

Currently  a  PSE  is  developed  specifically  for  the  MCCR  of  each  weapons  system,  and  is 
usually  rebuilt  several  times  during  Ae  life  of  Ae  system,  just  as  is  Ae  weapi^  system 
itself.  By  providing  a  clear  paA  for  PSE  development  and  upgrade JtOTAe  MCCR  of  a 
weapons  system,  the  cost  of  first  time  development  of  PSEs  for  MCCR  wiU  be  ^u^  as 
well  as  upgrade  and  maintenance  phases  of  Ae  PSEs.  Cost  can  be  reduced  by  minimizmg 
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the  cost  to  migrate  software  products  between  PSEs;  for  example  from  subcontractor  to 
prime  contractor  to  governmental  PSE. 

2.6.  NGCR  Program  Support 

Many  of  the  other  goals  in  this  section  are  also  goals  for  the  whole  NGCR  Program.  This 
section  describes  those  goals  or  constraints  imposed  on  interface  specifications  which  are 
due  to  limits  and  constraints  imposed  by  the  NGCR  Program  itself.  These  goals  are  not 
primarily  technical  in  nature.  The  NGCR  Program  has  several  goals,  such  as  the  goal  that 
the  interface  specifications  should  be  non-proprietary,  or  that  the  specifications  should  have 
wide  industry  use  and  support.  However,  these  goals  are  technical  goals  based  on  the 
higher  level  goals  of  getting  more  current  technology  at  lower  prices  into  Navy  computer 
systems. 

The  major  programmatic  goals  are  based  upon  the  program  deadlines.  The  program  plan 
calls  for  the  NGCR  PSEI  standard  to  be  in  place  by  1998.  The  interface  specifications 
chosen  for  inclusion  in  the  standard  must  be  mature  enou^  by  1996  to  be  included  in  the 
draft  standard.  Those  interface  areas  that  have  no  mature,  industry  accepted  interface 
specifications  by  the  1996  time-frame  can  not  be  included  in  the  standard. 

Another  programmatic  goal  is  that  the  standards  of  the  NGCR  Woiidng  Groups  should  be 
usable  together  when  building  systems.  This  goal  applies  less  to  the  PSEI  standard  than  to 
the  others  because  PSEs  do  not  need  to  be  built  to  real-time  inission-critical  requirements, 
but  only  need  to  be  able  to  produce  systems  that  are.  In  addition,  it  is  a  fundamental 
premise  of  the  NGCR  Program  that  standards  selected  by  the  Navy  reflect  an  "open 
systems"  approach.  Thus,  standardization  on  proprietary  designs  is  to  be  avoided. 

2.7.  Tool  Integration 

The  use  of  tools  for  project  management,  engineering,  debugging,  testing,  and  data 
management  provides  some  relief  from  the  complexities  of  development  that  modem 
systems  generate.  However,  the  present  lack  of  integration  of  these  tools  does  not  allow 
manual  steps  to  be  eliminated  in  moving  data  between  the  various  tool  groups.  Often, 
project  management  must  generate  paper  charts  for  the  design  phase;  test  results  must  be 
transferred  by  disk  or  paper  to  data  repositories.  Additional  manpower  is  required  when 
training  and  experience  does  not  reach  across  aU  of  the  tools. 

Integration  of  these  tools  in  a  common  fi'amework  with  a  common  user  interface  and 
databases  would  traly  release  their  power.  Project  managers  would  have  access  to  design 
data  for  insights  on  project  schedules.  Designers  would  be  able  to  examine  test  results  for 
performance  information. 

3.  General  Characteristics 

3.1.  Consistent  with  Other  NGCR  and  PSESWG  interfaces 

3.1.1.  Definition 

The  interfaces  chosen  to  be  part  of  the  NGCR  PSEI  standard  should  be  consistent  with 
each  other  and  to  a  lesser  degree  should  also  be  consistent  with  the  other  NGCR  standards 
and  general  industry  usage. 

3.1.2.  Relationships  to  Goals 
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This  characteristic  helps  build  user  confidence:  when  the  interfaces  are  consistent  and 
usable  together  there  is  less  risk  in  using  them.  It  also  reduces  Navy  system  engmeenng 
costs  when  the  interfaces  chosen  for  a  project  are  known  to  be  consistent.  This 
characteristic  also  supports  the  NGCR  Program  Support  goal. 

3.1.3.  Evaluation  Criteria 

10 . No  inconsistencies  found  for  candidate  interface  specification. 

5 . Several  minor  inconsistencies  found. 

0 . Major  inconsistencies  found  vrith  two  or  more  interfaces  already  chosen. 


3.1.4.  Rationale  for  Criteria 

It  is  most  important  to  look  for  inconsistencies  with  interface  specifications  already  chosen 
for  the  PSEI  standard,  so  it  should  be  given  the  most  weight  when  found.  Inconsistencies 
with  other  candidates  are  of  importance  even  if  the  other  canddates  ^e  not  cho^n  because 
they  represent  approaches  chosen  by  industry.  Being  inconsistent  with  other  industry 
approaches  limits  the  participation  of  industry.  The  other  NGCR  standards  ^only  weakly 
related  to  the  PSEI  standard,  so  those  inconsistencies  are  given  the  least  weight. 


When  an  inconsistency  is  found  it  can  be  classified  as  either  a  major  inconsistency  or  a 
minor  inconsistency.  Major  inconsistencies  should  courit  much  more  agam«  a  candidate 
than  minor  inconsistencies.  A  major  inconsistaicy  implies  that  the  two  interrace 
specifications  could  not  be  used  together  in  the  same  system  without  a  significaiit  loss  ot 
tetionality,  while  a  minor  inconsistency  implies  that  a  non-trivial  work-arourid  exists  tor 
the  inconsistency  allowing  the  two  interfaces  to  be  used  together  wid  only  a  mmor  loss  ot 
functionality.  Two  interfaces  should  not  be  considered  inconsistent  if  a  simple,  tiiyial 
work-around  allows  both  interfaces  to  be  used  together  without  loss  of  functionahty. 


3.2.  Interface  Sufficiency 

3.2.1.  Definition 

A  sufficient  interface  provides  aU  necessary  functionality  to  using  applications.  The  degree 
to  which  this  characteristic  is  satisfied  may  vary  depending  on  the  needs  of  a  particular 
application  or  ^plication  domain. 

3.2.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  User  Confidence,  Reduced  Navy  Cost,  and  Tool 
Integration. 

3.2.3.  Evaluation  Criteria 
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10 . AH  necessary  functionality  is  directly  available  via  the  interface. 

8 . All  necessary  functionality  is  either  directly  available,  or  else  is  available  by 

composition  of  directly  available  functionality  provided  at  the  interface. 

5 . Only  commonly  used  functionality  is  directly  available  or  available  by 

composition  of  directly  available  functionality  from  the  interface. 

1 . All  necessary  functionality  can  be  obtained,  but  may  require  adding  significant 

modules  that  use  the  interface  as  a  starting  point. 

0 . Significant  necessary  functionality  is  unavailable  via  the  standard  interface;  it 

may  either  be  completely  unavailable,  or  else  may  only  be  available  via 
proprietary  extensions  to  the  interface  standard. 

3.2.4.  Rationale  of  Criteria 

A  standard  interface  is  most  useful  if  it  provides  all  necessary  functionality  in  its  domain  of 
applicability,  rather  than  requiring  applications  to  develop  additional  layers  of  code  to 
provide  the  missing  functionality.  The  necessity  to  develop  additional  functionality 
increases  costs,  and  encourages  the  development  of  redundant  and  incompatible  solutions 
to  the  missing  functionality. 

3.3.  Extensible  Interface 

3.3.1.  Definition 

An  extensible  interface  is  an  interface  standard  which  allows  upward  mobility  for  new 
products  by  an  extension  path. 

3.3.2.  Relationships  to  Goals 

This  characteristic  directly  supports  the  goal  of  Quality  hiterface  (PSE  Extensibility).  An 
extensible  interface  is  vital  to  Transportability  of  Tools  and  Data,  and  indirectly  supports 
the  goal  of  Reduced  Navy  Cost.  As  new  tools  are  developed,  they  will  begin  to  obsolete 
the  interface  as  it  is  origmaUy  designed. 

3.3.3.  Evaluation  Criteria 

10 . Exterisibility  has  been  demonstrated. 

5 . Extensibility  features  exist  but  have  not  been  demonstrated. 

0 . No  extensibility  features  exist  or  extensibility  attempt  was  unsuccessful. 

3.3.4.  Rationale  for  Criteria 

Demonstrated  extensibility  provides  evidence  that  the  interface  will  support  future 
enhancements  without  major  changes  to  applications  using  the  current  interface. 


3.4.  Lasting  Interface  Technology 

3.4.1.  Definition 
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The  interface  is  in  use  at  the  time  of  its  selection  for  incorporation  into  the  PSH  ^^dard, 
and  will  be  in  wide  use  for  a  useful  period  of  time  foUowing  the  adoption  of  the  Pbbi 

standard. 

3.4.2.  Relationships  to  Goals 


This  characteristic  supports  the  primary  goal  of  Long  Life-time  ftoject  Support  md  the 
secondary  goals  of  Tool  Integration,  NGCR  Program  Support,  Reduced  Navy  Cost,  and 


User  Confidence. 

3.4.3.  Evaluation  Criteria 


10 . The  candidate  interface  is  widely  used  commercially,  and  is  the  clear  choice  by 

users,  where  applicable,  over  any  competition. 

5 . The  candidate  interface  is  available  commercially  on  a  number  of  pl^oims, 

and  is  the  clear  choice  by  users  where  available.  However,  Ae  candidate 
interface  has  competition  which  is  equally  available  and  utilized  by  users  on 
other  platforms. 

0 . The  candidate  interface  is  not  widely  available,  and  has  multiple  competitors 

. available  at  least  as  widely  on  the  same  or  different  platforms. 


3.4.4.  Rationale  for  Criteria 

This  is  a  subjective  prediction  based  upon  the  assumption  that  a  PSE  service  area  that  is 
experiencing  intense  competition  is  not  likely  to  have  settled  on  a  stable  choice. 


3.5.  Technology  Utilization 

3.5.1.  Definition 

The  specification  of  a  PSEI  standard  should  embody  state-of-the-practice  technology,  and 
should  be  implementation  independent. 

3.5.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  Long  Life-time  Project  Support  and  Tool 
Integration. 

3.5.3.  Evaluation  Criteria 

10 . The  specification  reflects  state-of-the-practice  and  does  not  depend  on  a 

particular  implementation  technology. 

5 . . . .  .The  use  of  the  specification  is  expected  to  decline  over  die  life-time  of  the 
PSEIs,  or  is  bound  to  a  particular  implementation  technology. 

0 . The  specification  reflects  obsolete  technology  and  is  unlikely  to  be  used  in  the 

near  foture. 

3.5.4.  Rationale  for  Criteria 

We  want  to  select  specifications  that  \vill  be  usable  during  the  life-time  of  the  PSEIs  and 
which  will  incorporate  newer  technology. 


3.6.  Stability  of  Interface  Specification 
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3.6.1.  Definition 

An  interface  specification  needs  to  be  relatively  stabile  over  the  life-time  of  the  PSEI 
standard,  with  incompatible  changes  unlikely,  if  it  is  to  provide  a  useful  level  of  PSE 
compatibility. 

3.6.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  User  Confidence,  Reduced  Navy  Cost,  and  Tool 
Integration. 

3.6.3.  Evaluation  Criteria 

10 . The  candidate  interface  is  not  expected  to  undergo  major  or  Sequent 

incompatible  changes. 

5 . The  candidate  interface  is  expected  to  undergo  minor  or  infrequent 

incompatible  changes. 

0 . The  candidate  interface  is  likely  to  undergo  major  or  frequent  incompatible 

changes. 

3.6.4.  Rationale  for  Criteria 

An  interface  that  is  subject  to  major  or  fiequent  incompatible  changes  will  require  excessive 
rework. 

3.7.  Compatibility  With  Older  Versions 

3.7.1.  Definition 

The  specifications  chosen  to  be  part  of  the  NGCR  PSEI  standard  should  be  compatible 
with  respect  to  data  and  function  of  older  versions. 

3.7.2.  Relationships  to  Goals 

The  characteristic  of  upward  compatibility  will  bmld  user  confidence  and  provide 
consistency.  It  will  reduce  Navy  project  costs  by  reducing  user  retraining  and  data 
conversion  time.  This  characteristic  directly  supports  the  goal  of  Long  Life-time  Project 
Support. 

3.7.3.  Evaluation  Criteria 

10 . Completely  compatible  with  older  versions. 

5 . Several  minor  inconsistencies  with  older  versions. 

0 . Major  inconsistencies  with  older  versions. 

3.7.4.  Rationale  for  Criteria 

Complete  upward  compatibility  is  the  goal  for  a  NGCR  PSEI  standard  interface. 

It  is  possible  to  move  upward  with  a  few  minor  inconsistencies,  however  retraining  and 
conversion  costs  will  be  incurred. 

An  interface  which  requires  major  retraining  and  conversion  efforts  should  not  be 
considered  upwardly  compatible. 
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3.8.  Support  Exists  For  Interface  Specification 

3.8.1.  Definition 


SuDDort  for  the  interface  specification  exists  in  the  form  of  actively  meeting  users  ^ups 
or  technical  conferences,  ^blically  available  tutorials  or  training  courses,  and  pubhcanons 

(textbooks,  etc.). 

3.8.2.  Relationships  to  Goals 


This  characteristic  supports  the  goals  of  User  Confidence,  Long  Life-time  Product 
Support,  and  NGCR  Program  Support. 

3.8.3.  Evaluation  Criteria 

10 . Regularly  meeting  users’  groups,  technical  conferences,  pubUcaUy  available 

tutorials  or  training  courses,  and  currently  published  technicallx)oks  or 
documentation  exist  that  provide  technical  support  for  the  interface 
specification. 

5 . Technical  books  or  documentation  exist,  but  there  ^e  no  regular  meetiiigs  of 

tfifhnirai  organizations  related  to  the  interface  specification;  consequently, 
technical  support  is  limited. 


0 . No  publically  available  support  exists. 

3.8.4.  Rationale  for  Criteria 

Users  will  perceive  more  risk  without  the  availability  of  ^tive  usen;  or  experte  in  the  use  of 
the  interface.  They  will  incur  higher  costs,  especially  during  first  time  use,  without 
technical  help  providing  answers  to  questions  and  lessons  learned. 


3.9.  Stature  of  Sponsoring  Organization 

3.9.1.  Definition 

The  specification  should  be  an  international  {e.g.,  ISO)  standard  as  opposed  to  a  Navy- 
only  or  DoD-only  standard. 

3.9.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  User  Confidence,  Long  Life-time  Project  Support, 
and  NGCR  Program  Support. 

3.9.3.  Evaluation  Criteria 
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10 . Approved  standards  developed  by  accredited  international  bodies. 

10 . Approved  standards  developed  by  accredited  regional  bodies. 

10 . Approved  standards  developed  by  accredited  national  bodies. 

8 . E>raft  standards  developed  by  accredited  international  bodies. 

8 . Draft  standards  developed  by  accredited  regional  bodies. 

8 . Draft  standards  developed  by  accredited  national  bodies. 

6 . Recognized  de  facto  standards  and  specifications  developed  by  non-accredited 

bodies  using  an  open  forum. 

4 . Approved  standards  and  specifications  developed  by  non-accredited 

international  standards  bodies  using  a  closed  forum. 

4  . Approved  standards  and  specifications  developed  by  non-accredited  national 

standards  bodies  using  a  closed  forum. 

2 . Product. 

0 . None  of  the  above. 

3.9.4.  Rationale  for  Criteria 

A  goal  stated  in  the  POM  is  to  adopt  commercial  standards.  Vendors  and  users  alike 

use  a  standard  that  has  wide  acceptance.  A  larger  audience  will  exist  for  building  experience 

and  evolving  the  standard. 

3.10.  Availability  of  Suitable  Documentation 

3.10.1.  Definition 

In  addition  to  the  specification  itself,  documentation  for  at  least  the  implementor  and  user 
should  exist. 

3.10.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  Quality  hiterface,  User  Confidence,  Reduced  Navy 
Cost,  and  NGCR  Program  Support. 

3.10.3.  Evaluation  Criteria 

10 . Multiple  sources  for  detailed  documentation  of  various  types  are  available. 

5  . Only  minimal  set  of  documentation  exists. 

0 . Nothing  is  addition  to  the  specification  is  available. 

3.10.4.  Rationale  for  Criteria 

Detailed  documentation  with  illustrative  examples  is  essential  to  insure  broad  use  of  the 
interface  specification  and  to  maximize  interoperability. 
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3.11.  Navy  Influence  in  Community  Maintaining  Interface 

3.11.1.  Definition 

The  Navy  must  have  the  ability  to  propose  changes  to  die  inteif^  stmdaid  mth 
expectation  of  a  fair  hearing  on  the  proposal's  merits.  This  tequues  a  formaMocumented 
mechanism  for  change  proposal  and  change  evaluation.  The  Navy  must  not  a 
SsS^tage  with  reject  to  other  users  of  the  interface  when  ^kmg  to 
Sace  definition  or  to  guide  the  direction  of  its  evolution.  It  is  not  required  that  Navy 
control  the  interface  maintenance  activity,  but  merely  Aat  fte  Na^  have  some  real  abihty  to 
influence  the  decision  process  with  regard  to  changes  in  the  mtertace. 

It  is  further  required  fliat  a  formal  process  be  documented  for  reporting  poblenw 
discovered  widi  the  interface  standard.  The  process  must  mclude  a  mechanism  tor  , 
Sablishing  the  priority  of  problem  reports  for  consideration  by  the  community  maintainmg 

the  interface. 

3.11.2.  Relationships  to  Goals 

The  ability  of  the  Navy  to  influence  the  community  maintaining  th^terface  is  import  to 
several  of  flie  Navy's  top  level  goals,  including  development  of  sufficient  mer  confidence 
in  the  interface  standard  and  reduction  of  Navy  costs.  In  addition,  it  is  tightly  coupled  with 

NGCR  Program  objectives. 

3.11.3.  Evaluation  Criteria 

10 . Expect  most  Navy  interests  to  be  in  common  with  most  other  constituents. 

5 . Expect  some  Navy  interests  to  be  in  common  with  many  other  constituents. 

0 . Expect  Navy's  views  to  be  in  minority  on  most  issues. 

3.11.4.  Rationale  for  Criteria 

The  NGCR  Program  seeks  to  reduce  costs  through  adoption  of  . 

interface  stand^s.  The  adoption  of  such  standards,  however,  means  a  loss  of  full  control 
over  the  interfaces.  Consequently,  the  assurance  of  user  confidence  m  the 
standards,  which  is  itself  necessary  for  success  in  achieving  a  practical  stand^d,  dema^ 
appropriate  Navy  influence  within  or  upon  the  community  responsible  for  maintammg  the 
imerf^.  The  Navy  is  likely  to  have  the  best  chance  of  exertmg  this  influence  where  its 
interests  are  most  in  common  with  other  users  of  the  standard. 

3.12.  Acceptance  by  Commercial  Providers 

3.12.1.  Definition 

The  interface  standard  must  not  only  be  embraced  by  we^n  systems  developere  who  also 
build  support  environments,  but  also  by  commercial  entities  who  must  build  products  to 

meet  the  specification. 

3.12.2.  Relationships  to  Goals 

This  characteristic  is  related  to  the  goals  of  User  Confidence,  Long  Life-time  Support, 
Reduced  Navy  Cost,  and  NGCR  Program  Support. 

3.12.3.  Evaluation  Criteria 
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10 . Commercial  providers  actively  support  specification  development  and  have 

available  products. 

5 . Commercial  providers  are  supporting  specification  development,  but  are 

building  prototype  products. 

0 . Commercial  providers  are  ignoring  the  NGCR  PSEls  and  are  building 

products  to  other  or  no  standards. 

3.12.4.  Rationale  for  Criteria 

A  stated  goal  of  the  NGCR  Progr^  is  to  work  with  commercial  interests  to  develop 
specifications.  These  commercial  interests  must  be  actively  supporting  the  specification 
development  and  show  their  understanding  and  perception  of  low  risk  by  using  the 
standards  developed  for  their  product  lines. 

3.13.  Nonproprietary  Interface  Specification 

3.13.1.  Definition 

An  interface  specification  is  nonproprietary  if  either  it  is  not  based  on  the  interfaces 
exported  by  a  particular  proprietary  product,  or  else  the  vendor  of  the  proprietary  product 
has  released  the  exported  interface  specification  into  the  public  domain  so  that  competing 
vendors  can  build  to  the  interface  without  paying  for  the  privilege. 

3.13.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  Transportability,  Long  Life-time  Project  Support, 
Reduced  Navy  Cost,  and  NGCR  Program  Support. 

3.13.3.  Evaluation  Criteria 

10 . The  interface  specification  is  a  formal  standard  (e.g.,  ISO,  ANSI,  IEEE,  etc.). 

8 . The  interface  specification  is  an  industry  standard  implemented  by  multiple 

vendors  without  royalties  to  an  "owner". 

5 . The  interface  specification  is  an  industry  standard  implemented  by  multiple 

vendors,  but  licensed  by  an  "owner"  to  those  vendors. 

1 . The  interface  specification  is  an  industry  standard  implemented  by  multiple 

vendors,  but  the  implementation  must  be  acquired  from  the  "owner". 

0 . The  interface  specification  is  implementable  by  only  one  vendor. 

3.13.4.  Rationale  for  Criteria 

Proprietary  interface  specifications  conflict  with  the  goal  of  expanding  competition  and 
increasing  product  avtulability. 

3.14.  Low  User  Risk 

3.14.1.  Definition 
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during  the  Engineering  ana  jvianuiacniniig  uic 

risk  to  the  user.  Otherwise,  the  user  will  pursue  waivers  or  work-around  strategies. 

3.14.2.  Relationships  to  Goals 

This  characteristic  supports  the  goals  of  Quality  p  . 

Friendliness),  User  C^fidence,  Long  Life-time  Project  Support,  and  Reduced  Navy  Cost. 

3.14.3.  Evaluation  Criteria 

10 . Standard  has  been  successfully  used  on  a  prior  program,  and  is  adequately 

supported. 

5 . Standard  has  been  used  in  a  prototype  with  a  substantial  body  of  information 

. indicating  it  can  be  used  successfully  on  a  real  program. 

0 . Standard  has  not  been  used  on  a  real  program. 

3.14.4.  Rationale  for  Criteria 

All  weapons  system  development  decisions  are  bas^  in  large  part  o"  ^ 

measured  risk,  hi  the  later  phases  of  development,  less  risk  is  allow^l^  The  user  must 
feel  that  the  level  of  risk  is  acceptable,  or  he/she  will  not  use  the  standard. 

3.15.  Language  Bindings  Exist 

3.15.1.  Definition 

Many  of  the  interface  specifications  will  require  an  application  programmmg  interface  (API) 
so  that  tool  buUders  and  integrators  can  write  programs  that  ^cess  the  services.  Some 
interfaces  are  specified  in  a  language-independent  manner  rather  *an  in  a  p^lar 
orogramming  toguage.  This  is  especially  true  of  mtemanonal  spwifications.  To  meet  goals 
for  portability,  the  interface  specification  must  include  language  bmdmgs  for  the  major 
programming  languages  used  for  developing  PSEs:  Ada  and  C. 

3.15.2.  Relationships  to  Goals 

This  characteristic  is  needed  to  achieve  the  goal  of  tool  and  user  pormbility.  Standard 
language  bindings  allow  tools  to  be  transported  by  recompiling  on  systerm  This 

cScteristic  also  makes  tool  integration  easier  ^d  will  reduce  the  PSESWG  effort  needed 
to  produce  a  standard  that  includes  a  language  binding  for  the  mterface. 

3.15.3.  Evaluation  Criteria 

10 . has  both  Ada  and  C  binding  standards. 

6 . has  binding  standard  in  Ada  only. 

4 _ has  binding  standard  in  C  only. 

0 ....  .has  no  Ada  or  C  binding  standard  available. 

3.15.4.  Rationale  for  Criteria 

(Note:  this  characteristic  is  not  applicable  to  specifications  that  do  ne^  an  API.)  The 
two  major  languages  for  current  PSE  development  are  Ada  and  C.  (^er  lan^ages  were 
not  considered  because  bindings  in  those  languages  would  not  significantly  aid  m  achieving 
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binding  standards  in  these  two  important  languages  and  it  is  expected  that  few 
environments  would  require  other  language  bindings.  Ada  is  given  priority  over  C  because 
of  the  emphasis  within  DoD  on  the  use  of  Ada. 

Also,  there  are  4  levels  of  binding  status,  with  priority  or  value  decreasing  from  top  to 
bottom: 


a . Binding  standard  exits. 

b . Draft  standard  or  industry  de  facto  standard  exists 

c . A  base-line  specification  that  can  be  used  to  start  a  standardization  effort  exists. 

d ..... .No  binding  exists 

3.16.  Conformance  Tests  are  Available 

3.16.1.  Definition 

Conformance  tests  are  used  to  evaluate  a  candidate  product's  conformance  to  a  particular 
standard  by  running  tests  on  that  product. 

3.16.2.  Relationships  to  Goals 

This  characteristic  supports  the  goal  of  User  Confidence,  Data  Transportability  and  Quality 
Interface  (Testability). 

3.16.3.  Evaluation  Criteria 

10 ... .  .Formal/rigorous/complete  conformance  tests  are  available. 

5 . Some  conformance  tests  are  available. 

0 . Conformance  tests  are  not  available. 

3.16.4.  Rationale  for  Criteria 

Any  level  of  conformance  testing  is  better  than  nothing,  but  partial  conformance  testing 
may  give  a  false  impression  of  the  quality  or  level  of  conformance. 

3.17.  Transportable  Data 

3.17.1.  Definition 

The  data  produced  by  a  PSEI  specification  should  be  transportable  between  tools  and 
environments  without  major  conversion. 

3.17.2.  Relationships  to  Goals 

When  data  is  transportable  between  tools  and  environments  without  major  conversion,  the 
cost  of  Navy  systems  is  reduced  and  user  confidence  in  the  data  is  increased. 
Transportability  of  data  allows  the  user  to  consider  a  wider  variety  of  interfaces  and 
removes  the  ne^  for  specialized  products. 

3.17.3.  Evaluation  Criteria 
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10 . Data  is  transportable  between  tools  and  environments. 

5 . Minor  conversion  is  necessary  in  order  for  the  data  to  be  transported. 

0 . Major  conversion  is  necessary  to  transport  data. 


3.17.4.  Rationale  for  Criteria 


Having  the  capability  to  transport  data  between  interfaces  reduces  the  cost  of  Navy  systems 
and  increases  the  user’s  confidence  in  the  data.  The  more  transportable  the  dara  is  with 
other  PSEIs,  the  more  open  the  selection  will  be  when  choosing  a  project  environment. 


Transportability  can  be  achieved  with  several  minor  inconsistencies  in  the  data  Navy 
projea  costs  are  increased  by  data  conversion  efforts  and  user  confidence  m  the  data  is 
decreased. 


A  major  conversion  effort  implies  that  two  interfaces  cannot  exchange  data  The  project 
environment  selection  would  be  limited. 


3.18.  Heterogeneous  Distribution 

3.18.1.  Definition 

A  heterogeneous  distributed  system  is  a  collection  of  multiple,  independent  but  logically 
related  heterogeneous  processors  cormected  by  a  computer  network.  It  permits  the 
development  and  manipulation  of  distributed  data  and  functions  on  disparate  systems  while 
making  the  distribution  transparent  to  the  user  and  provides  user  control,  as  necessary. 
Heterogeneous  distributed  systems  allow  data  to  be  entered,  process^,  and  storM  where  it 
is  generated,  shared  with  different  sites,  and  repUcated  to  give  users  the  option  of  accessmg 
copies  of  data  in  the  event  of  a  site  or  network  failure. 

3.18.2.  Relationships  to  Goals 


This  characteristic  supports  the  goals  of  Quality  Interface  (PSE  Eirtenability), 
Transportable  Data,  Reduced  Navy  Cost,  and  Long  Life-time  Project  Support. 

3.18.3.  Evaluation  Criteria 


10 . Specification  has  demonstrated  support  for  heterogeneous  distributed  systems. 

5 . Specific  support  for  heterogeneous  distributed  systems  is  minimal,  but  nothing 

precludes  support. 

0 . Not  useful  in  a  heterogeneous  distributed  system. 


3.18.4.  Rationale  for  Criteria 

Evaluation  criteria  for  heterogeneous  systems  must  examine  heterogeneity  issues  in  areas 
such  as  the  following: 
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a . existing^lanned  hardware/firmware/software 

b . current  and  future  operating  systems 

c . communications  protocols 

d . communications  links 

e . data  management  systems 

f . data  models 

g . Hata  manipulation  languages  and  transaction  management  protocols 

Site  autonomy,  with  each  site  in  the  heterogeneous  distributed  system  maintaining  control 
and  privacy  of  data,  must  be  preserved  while  allowing  users  to  commonly  share  data  ^ 
varied  sites.  Continuous  operation  of  the  system  must  be  preserved  with  no  system-wide 
down  time  for  random  or  planned  events.  Data  location,  fragmentation,  and  replication 
must  be  transparent  to  the  user  and  to  any  shared  applications.  Systems  o^rations  must  be, 
during  performance  and  conformance  testing,  as  well  as  long-term  operation,  hardware, 
operating  system,  and  network  independent  from  the  user's  viewpoint. 

To  obtain  a  high  degree  of  reliability,  availability,  maintainability,  and  stability  frrom 
heterogeneous  distributed  systems,  the  transparent  communication  of  data  rriust  be  available 
across  multiple  sites.  Dynamic  processing  of  common  data  and  commumcations  must  deal 
with  the  analysis,  optimization  and  execution  of  distributed  processing  while  each  site 
carries  on  its  own  local  execution  load.  This  must  occur  transparently  while  aspects  of  the 
network  are  subjected  to  varying  traffic  patterns  and  bottlenecks.  The  development  of  new, 
heterogeneous  distributed  processing  technology  is  stimulating  the  development  of 
applications  that  require  support  for  distributed  communications  and  data  processing.  In 
turn,  the  ability  to  share  data  from  environment  to  environment  must  be  based  on  proper 
system  integration  and  system  cooperation  in  order  to  reduce  long  term  system 
development  and  operation  costs  and  improve  user  productivity. 

3.19.  Hardware  Independent 

3.19.1.  Definition 

Hardware  independence  indicates  the  degree  a  configur^on  item  (software,  hardware, 
interface,  standard)  depends  on  the  hardware  and  operating  system  of  a  particular  host. 

3.19.2.  Relationships  to  Goals 

By  definition,  hardware  independence  is  cmcial  to  the  tran^ortability  of  data  and  tools 
without  standardizing  on  a  particular  hardware  product  This  characteristic  also  supports 
the  goals  of  User  Confidence,  Long  Life-time  ftoject  Support,  and  Reduced  Navy  Cost. 

3.19.3.  Evaluation  Criteria 
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10 . is  completely  independent  of  the  host  hardware  and  operating  system. 

6 . depends  on  host  operating  system. 

4 . depends  on  host  hardware. 

0 . depends  on  both  hardware  and  software. 


3.19.4.  Rationale  for  Criteria 

Since  popular  operating  systems  are  usually  developed  to  be  hardw^-independent 
themselves  (e.g!rUnix),  standardization  of  an  interface  on  a  particular  opw^g  system 
product  does  not  impact  transportability  as  much  as  hardware  standardization. 


3.20.  Security 

3.20.1.  Definition 


The  PSE  interfaces  must  be  compatible  with  commercial  and  government  definitions  of 

..  • _ ......  4ri  npnnirpmpntc  milltHrV  USCTS  Ol 


secure  services  anu  - - u^4.u 

and  access  to  data  and  processes.  Security  provisions  for  PSE  mterfaces  “V^t  supp^  both 
concepts  of  security  mentioned  previously.  Many  of  the  security  services  which  must  be 
specified  in  PSE  interfaces  will  be  transparent  to  users  when  the  system  is  runmng. 

Security  provisions  are  most  commonly  defined  in  the  U.S.  using  the  teriM, 


The  Computer  System  Laboratory  (CSL)  of  NIST,  as  part  of  its  pro^  to  promulg^e 
technical  computer  security  guidelines,  has  publ«hed  the  Computer  Se^ty  Subsyrfem 
Interpretation  of  the  TCSEC  which  provides  further  rationale  and  defimtions  pertment  to 
security  implementations  on  computer-based  systems. 

3.20.2.  Relationships  to  Goals 

Classified  data  will  be  processed,  at  a  minimum,  by  operating  systems,  networks,  and 
database  products,  and  will  be  passed  from  one  phase  of  pro^am  development  together. 
This  may  include  transferring  from  one  PSE  to  another.  Interface  specific^ons  wluch 
provide  proper  support  to  security  considerations  support  the  TranspOTtabuity,  QJupty 
hiterface,  L^g  Life-time  Project  Support,  Reduced  Navy  Cost,  and  Tool  Integration 

goals. 

3.20.3.  Evaluation  Criteria 

10 . Specification  has  been  implemented  with  multilevel  secure  provisions. 

5 . Specification  does  not  prohibit  security  provisions. 

0 . Specification  is  not  adequate  to  support  security  provisions. 

3.20.4.  Rationale  for  Criteria 

The  security  characteristic  must  be  assurable  for  any  PSE  which  could  host  secure  d^a  in 
any  phase  of  project  life.  However,  if  a  particular  PSE  will  never  host  sec^  data,  fte 
secvmty  requirements  need  not  apply.  Security  standards  exist  m  two  broad  categories:  1) 
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specifications  for  DoD  Trusted  Computer  Systems  provided  in  a  series  of  DoD  dwuments, 
and  2)  encryption  and  authorization  standards  for  privacy  and  proprietary  control  in 
commercial  systems. 

Navy  PSEs  will  be  required  to  store,  process,  and  transfer  classified  data  with  secure 
methods  satisfying  DOD  security  standard  requirements.  A  PSEI  which  does  not  provide 
adequate  provisions  for  secure  interfaces  will  not  support  Navy  projects  with  classified  data 
and  processing  requirements. 

PSEIs  such  as  those  for  operating  systems,  networks  (local  and  wide  area),  and  datable 
systems  which  process  secure  data  must  be  supportable  in  a  PSE  with  multilevel  security 
provisions. 
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